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ABSTRACT 

To evaluate the effectiveness o£ a new writing 
curriculum in the Oak Ridge Schools (Tennessee), modeled after the 
process-oriented National Writing Project, a three-year study of 
student writing was conducted. The study consisted of evaluating 
writing samples collected from 90 students in grades 3 through 12 
over 3 consecutive years, and surveying by means of annual 
questionnaires the writing attitudes of students, parents, and 
teachers* Results from the student attitude surveys show an increase 
over the second and third year in students' interest in learning 
about writing, in their level of confidence, and in their association 
of sel£--esteem with good writing* A decrease was observed in 
students* feelings of discomfort about completing writing assignments 
and in their feelings that they do not wr\te well and that writiag is 
difficult* At the end of the study, students at each grade level were 
better writers than were previous students in that grade level. 
Students in classrooms with teachers trained according to the 
National Writing Project approach performed better on the writing 
sample than did students in the classrooms of untrained teachers* The 
teacher survey showed few differences between trained and untrained 
teachers in attitudes about writing, ranking of writing problems, and 
assessment of language arts priorities* Some significant differences 
were found between parent and teajher attitudes* (Recommendations of 
the writing committee are included, and writing assignments and 
assessment rubrics are appended*) (JG) 
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Student writing has long been a concern of teachers and administrators at 
elementary, junior and senior high levels. 3chool systems as a whole, and 
individual classroom te.achr.rs, have been interested in techniques and 'approaches 
to teaching writing that would improve both the students' ability to write and 
the students' attitude toward writing. 

During the 1982-1983 school year, a group of language arts teachers from 
the various Oak Ridge Schools met to discuss how to teach writing more 
effectively. The group agreed that a system-wide approach to teaching writing 
would be more likely to improve student writing than would the approach to 
writing used at that time, which was each teacher independently developing and 
implementing his or her own approach to writing. Also, the language arts 
teachers involved agreed that a system-wide emphasis on writing would encourage 
teachers to allot more time to teaching writing. After reviewing the literature 
on the teaching of writing and analyzing several models of teaching writing, the 
group recommended the adoption of the National Writing Project for writing 
instruction. 

The National Writing Project, based on the Bay Area (San Francisco, CA) 
Writing Project, increasingly sresses writing as an active "process," as well as 
emphasizing a "product," the final written assignment. The process consists of 
five major steps: 

1. Pre -writing- -The teacher structures activities to help 
students develop ideas and organize information to use 
in ^ae written assignment. Activities include reading 
assignments, brainstorming and mapping. 

2. Writing- -The student, motivated by the prewriting 
activity, then writes the assignment. Students consider 
audience and purpose as they write. 

3. Peer Review- -Students work either in pairs or in small 
groups to read and react to each others' writing. 
Students usually have specific aspects of the writing 
that they are to analyze. The peer process stresses 
finding positive aspects of a peer's writing in addition 
to locating any weaknesses in the student's writing. 

4. Revision- -The student uses the suggestions made by 
others, including classmates and, often, the teacher, 
and revises his or her assignment. This stage involves 
reorganization and inclusion of new informfition, as well 
as correction of spelling and grammatical errors. 

5. Evalu.'^tion--The teacher evaluates the student's completed 
assignment. 

The National Writing Project is based, as well, on developing the writing 
abilities of teachers through an intensive inservice or training program. 
Throughout the training or workshop period, teachers are asked to work through 
the five-step process as they respond to writing assignments. The premise is 
that the more comfortable and skilled a teacher is with writing, the more 
sensitive and specific she can bfe with students' efforts. A second premise of 
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the National Writing Project is that by learning to write, students will learn 
to think and learn in active and responsive ways. This kind of learning is 
suitable not only for the English classroom, but for all other areas of the 
curriculum. A final characteristic of teaching writing as a process is the 
appreciation of a broader audience other than just the teacher. Students focus 
many final writing products for "publication" whether it be a letter to an 
editor, a handmade book of writings, a memo, or a newspaper story. The emphasis 
on audience and final products demands correct use of grammar and the ultimate 
goal: clear communication. 

During the fall of '983, 18 teachers from the Oak Ridge Schools were 
trained in how to teach writing based on the National Writing Project. 
Following Che one-week workshop, the 18 teachers, representatives from each 
school in the system, were to use the process approach to writing instruction in 
their classrooms. In addition, this group of teachers was namsd to serve on the 
newly formed Writing Committee. This committee, chaired by Ms. Jinx Bohstedt, 
met regularly throughout the next three years to discuss their experiences in' 
using the process approach to teaching writing and to discuss how writing 
instruction could be improved in the school system as a whole. 

The Writing Committee members agreed that one problem in assessing the 
effectiveness of any new curriculum is determining if, in fact, the new teaching 
approach has caused any change in student learning or student attitudes. 
Therefore, the group agreed that a research study of student writing in the 
school system could help determine if the adoption of process -based writing 
instruction resulted in improvements in student writing and student attitudes 
about writing. 

Professor Kathy Krendl, assistant professor in the Department of Tele- 
communications at Indiana University (Bloomington, Indiana), agreed to serve as 
the outside evaluatcr for a three-year study of student vriting. Working with 
Dr. Krendl, the Writing Committee determined that the study should consist of 
several components: 1) collecting a sample of student writing for three 
consecutive years and analyzing the writing samples to evaluate the writing; 
2) collecting information on student attitudes about writing by having students 
complete a questionnaire about writing each year; 3) collecting information on 
parent attitudes about writing by having the parents complete a mail 
questionnaire each year; and 4) collecting information from teachers, using 
self-administered questionnaires, on their attitudes about writing and 
techniques they used in teaching writing. 

Dr. Krendl drew a random sample of 90 students from each grade level- -third 
through tenth. The spjnple represented all ability levels of students, including 
students who were in resource rooms or mainstreamed into regular classrooms. 
The 90 students from each grade level and their parents were involved in the 
yearly analysis. 

The Writing Committee determined that all students in the school system, 
grades 3 through 12, not just the students in the three -year study, should 
participate i.. the yearly writing sample. Thus, the school system obtained a 
sample of every student's writing and all students had the opportunity to 
practice timed writing, a requirement for some standardized tests. In addition, 
students included in the sample were not sensitized to being selected; that is, 
their writing was done in the naturalistic classroom setting with all of their 
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classmates also participating. 

For three yaars, May of 1984, 1985 and 1986. every language arts ceacher 
was asked to set aside a pre-determined day to have all stuaents take part in 
the writing sample. Each teacher was provided with directions and with the 
topic that the students wtre to write on. To help standardize the writing 
samples, all teachers were asked to follow a set procedure in introducing the 
assignment and to allot the same amount of time to the assignment to help 
standardize the 'T'iting samples. 

The topics for the writing samples ^ere determined by the Writing 
Committee. In selecting a writing topic, the committee tried to design topics 
that all students could write about during one class period without needing to 
do any background preparation. The Writing Commitztee members also tried to 
structure the writing prompts (the exact wording that the teachers would use 
with their students) to match the students' writing experiences at the various 
grade levels. Consequently, students in grades 9-12 were asked to write multi- 
paragraph papers, whereas students below ninth grade were not asked to write 
such extensive papers. Topics and instructions for each writing assignment are 
presented in Appendix A. 

Each year after the students completed the writing sample, the papers by 
students in the research study weire pulled. A team of teachers, representing 
the three major grade levels- -£ lementary school. Junior high school and senior 
high school- -read and rated tb<i writing samples. 

The teachers used a rubric (a set of standard c-iteria) in assessing the 
samples. All writing samples, regardless of the student's grade level, were 
evaluated based on the same rubric (See Appendix 3). The same rubric was used 
in evaluating the writing samples for all three years of the study to establish 
consistency in evaluation . 

Prior to beginning their individual scoring of writing samples, the team 
members practiced using the rubric in evaluating student writing. This practice 
helped the team develop inter-reader reliability, meaning that all members of 
the team would evaluate and score the samples in a similar fashion. 

Each paper in the sample was read and scored holistically . In other words, 
a teacher would read the paper in its entirety and, using the criteria of the 
rubric, assign the paper a score of 1 (low) to 6 (high). The teacher would make 
no marks on the paper and would not discuss it with the other team members. 
Each paper was read by two teachers . If the two teachers did not give the paper 
the same numerical score, a third teacher would read and score the paper. The 
paper would receive the score agreed on by two of the three teachers. 

The papers in the sample and their scores were sent each year to Dr. 
Krendl. She compiled the scores from the thr^ie years of writing samples, along 
with the data from the students', parents' and teachers' questionnaires. 
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Part 1 

Results from the Student Sample 
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Student Attitudes about; Writing 

Each year one action of tne students' questionnaire was a series of 
statements about writing. These statements asked about students' interest in a 
variety of areas— learning about writing, confidence in writing ability, 
importance of mechanics in writing, value of writing as a skill, and value of 
writing in determining self-esteem. Each student responded to each statement on 
a scale of one (strongly disagree) to five (strongly agree). The mean scores of 
all students' responses to each statement were tabulated for each of the three 
years of tha study. The scores of the second and third years were compared to 
the scores of the first year to determine any changes in student attitudes 
toward writing. Table 1-1 indicates the direction and degree of change from the 
first year to the third year of the study. 

The first set of statements dealt with the student's interest in learning 
about writing. In both the second and third year of the study, int^srest in 
learning about writing increased significantly. The other significant result in 
this group of statements was the decrease in students' feeling that "learning 
about writing makes me uncomfortable." By the third year of the study, students 
were significantly more comfortable in completing writing assignments.' 

In a similar trend, the next group of statements demonstrates significant 
decreases in students' fepMngs that they do not write well and that writing is 
difficult. Again, their level of confidence seems to have improved reeardine 
their writing. 6 & 

In terms of the importance of mechanics (grammar and spelling), no changes 
occurred during the course of the study. Furthermore, there were no significant 
changes in students' ratings of the value of writing as a skill. However, it is 
important to note in both groups of statements that students' ratings of the 
skills involved in writing and the importance of writing as a skill are quite 
high even in the first year. It would be difficult to move them significantly 
higher on these ratings. That is, at the outset, studen-. already considered 
writing and its related skills as an important part of their education in 
preparing them for future jobs. 

Finally, this table demonstrates that consistent significant changes 
resulted during the course of the study in terms of the self-esteem students 
associated with good writing. In their estimates, parents and teachers (but not 
their friends), as well as they, themselves, would all be proud if they were 
good writers. This finding suggests that one result of adopting the process- 
based writing curriculum was that a clear message went out to students: good 
writing is something to be proud of. However, we cannot conclude that the 
curricular innovation was directly responsible for these changes because they 
occurred for all students, not only students who were exposed to teachers 
trained in process -based writing instruction. Therefore, we need to test for 
differences in writing attitudes between students in the classrooms of trained 
and untrained teachers. 
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When we examine the specific effects of teacher training on student 
attitudes about writing, rather than the overall changes over time, the findings 
are less consistent and clear. Very few significant differences emerge as is 
illustrated in Tables 1-2 and 1-3. both of which examine the effects of teacher 
training on student attitudes about writing. Table 1-2 er.amines the effects on 
attitudes each year of having a trained or an untrained teacher. Thus, this 
tab:ie poses the question: What difference did having a trained teacher make at 
any one point in time during the three years of the study? 

Tr.ble 1-3 presents the cumulative effects of having trained teachers over 
the three years of the study. Because different groups of teachers were trained 
at different times, it was possible for students to have three full years of 
instruction from trained teachers, or no exposure to trained teachers during the 
course of the study. The results presented in this table respond to the 
question: What were the cumulative effects of having trained teachers on 
student attitudes about writing? 

As these tables illustrate, in general, the trends of change over the three 
years of the study are positive where one would expect them to be positive, and 
negative where one would expect them to be negative, but these dif f erences ' are 
not significant. That is, they could be explained by chance variation, and 
cannot be attributed to the effect of teacher training. For example, in Table 
1-2, students' responses to the statement, "I would like the idea of taking 
writing classes," ere more positive each year for students with trained teachers 
than for students with untrained teachers, but we cannot conclude that teacher 
training accounts for these differences because they are not consistently 
significant. Table 1-3 shows similar results. Again, there are few consistent 
differences between students with trained and untrained teachers. 
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Table 1-1 
Student Attitudes about Writing 



Students were asked to respond to the following statements. The answers ranged 
from 1 (strongly disagree) to 5 (strongly agree) . 

First Year Second Year Third Year 

Interest in learning about writing 

I would like to learn more 3.23 3.47* 3 52* 

about writing. 

I would like the idea of taking 2.67 2.63 2.67 

writing classes. 

I enjoy learning about writing. 2.92 2.93 2.94 

Learning to write can be fun. 3.16 3.33 3 ig 

Learning about writing makes me 3.70 3.79 2^17* 

uncomfortable. 

Confidence jji writing ability 

I feel good about my 3.60 3.75 3 75 

writing ability. 

I am not the kind of person 3.30 3.56 2 42* 

who writes well. 

It is difficult for me to write. 3.71 3.66 2 37* 



Importance 2f mechanics in writing 

In order to be a good writer, 3.82 3.8^! 

you need to be good at grammar. 
In order to be a good writer, 4.07 
you need to be good at spelling. 



3.97 

3.88 3.88 



Valiife writin g ^ ^ skill 

Every student should have some 4.27 4.34 4,31 

understanding of writing. 

Knowing about writing will help 4.18 4. 08 4.10 

me get a better job. 

Value of . rrtting in self-esteem 

If I were a good writer, my 2.99 3.55* 3.62* 

parents would be proud of me. 

If I were a good writer, my 3.43 3.85* 3 97* 

teacher would be proud of me . 

If I were a good writer, my 2.48 2.53 2 50 

friends would be proud of me. 

If I were a good writer, 3. 60 4.05* 4.00* 

I'd be proud of uyself. 

*p<.05 for differences compared to First Year ratings. 
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Table 1-2 

Student Accicudes about Writing by Teacher Training 



lYear 1 Year 2 Year 3 

T^ 



Interest irj learning about writing 
I would like to learn more 
about writing, 

I would like the idea of taking 
writing classes. 
I enjoy learning about writing. 
Learning to write can be fun. 
Learning about writing makes me 
uncomfortable. 

Confidence jjx writing ability 
I feel good about my 
writing ability. 
I am not the kind of person 
who writes well. 

It is difficult for me to write. 

Importance of mechanics ij\ writing ability 
In order to be a good writer, 
you need to be good at grammar , 
In order to be a good writer, 
you need to be good at spelling. 

Valiie 2f wiJjJLnfi ^ a skill 
Every student should have some 
understanding of writing. 
Knowing about writing will help 
me get a better job. 

Valiie of writing jji self-esteem 
If I were a good writer, my 
parents would be proud of me. 
If I were a good writer, my 
teacher would be proud of me. 
If I were a good writer, my 
friends would be proud of me. 
If I were a good writer, 
I'd be proud of myself. 

refers to untrained teachers each year; T refers to trained teachers each 
year. 

*p<.05 for differences between having trained and untrained teachers. 
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Writing Attitudes by Cumulative Teacher Training^ 
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More teachers* wece trained each year of the study, so that the cumulative 
teacher training index indicates the number of trained teachers each student had 
over the course of the three years of the study. Thus, some students had no 
trained teachers, or a score of 0 on cumulative teacher training, while others 
had trained teachers all three years, or a score of 3 by the third year. 
*p<.05 for differences in cumulative teacher training. 
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StU<i^nt Atttt^dfea afrQUt writing Problems 



Students were also asked to rate the degree to which they had problems with 
particular aspects jf writing. The problems included: putting things in order 
(organization), knowing how to begin, finding the right words vocabulary), 
spelling, following directions, finding errors, grammar, neatness, trying to 
make it better (rewriting), thinking of a topic to write about, and thin^ving of 
what to say on a topic. The three tables below present the results of students' 
rank order of the extent to which each of these items was a problem in their 
writing for each year of the study. The grade levels included in the table 
refer to diffei:?nt students each year, reflecting that most students in the 
study advanced a grade each year. 

As these tables (1-4 through 1-6) demonstrate, students' perceptions of the 
importance of specific problems in their writing were relatively constant over 
time. Tb« most consistent finding in all three years is that "following 
directions" is the least of the students' problems at all grade levels. Thi3 
item comes in dead last at all grade levels in the first and third year of the 
study. In the second year, it is always last or next to last. Thus, it appears 
that in the students' minds, teachers are clear in terms of giving directions 
for particular writing assignments. Another consistent finding is that 
perceptions of the importance of particular problems varies according to grade 
level. For example, "finding a topic" is a very important problem in the lower 
grades for all three years. In addition, "neatness," "finding errors," and 
"thinking of what to say on a topic" arc perceived as important problems for 
elementary and middle school rriters. As students enter the high school years, 
the more technical aspects of writing diminish in importarce and are replaced by 
"knowing how to begin" as the most critical problem. **Thiaking of a topic" 
remains important: even in high school. High school students consistently rank 
"grammar," "neatness," and "spelling" among the least of their problems. Thus, 
it appears that by this point in their careers, students think they have 
mastered the basic skills required for writing and are more concerned about 
content. Because student perceptions of writing problems are so consistent 
over the three years of the study, it appears that the changes adopted in 
teacnlng process -based writing had little impact on the relative importance of 
particular problems from the students' perspective. 
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Table 1-4 

Rank Order of Writing Problems by Grade 
First Year of Study 



Fifth 



Sixth 



Seventh 



Eighth 



Ninth 



Tenth 



Topic 

Errors 

Neatness 

What to say 

Rewriting 

Beginning 

Spelling 

Vocabulary 

Organization 

Grammar 

Directions 



Topic 

Beginning 

Neatness 

What to sey 

Errors 

Vocabulary 

Rewriting 

Spelling 

Oganization 

Grammar 

Directions 



Topic 

Neatness 

Beginning 

Rewriting 

Errors 

What to say 

Spelling 

Grammar 

Vocabulary 

Organization 

Directions 



Topic 

Beginning 

Neatness 

Errors 

What to say 

Rewriting 

Organization 

Grammar 

Spelling 

Vocabulary 

Directions 



Topic 

Beginning 

What to say 

Neatness 

Errors 

Rewriting 

Spelling 

Vocabulary 

Grammar 

Organization 

Directions 



Beginning 

Topic 

Errors 

Rewriting 

Organization 

What to say 

Vocabulary 

Grammar 

Neatness 

Spelling 

Directions 



10 15 



Table 1-5 

Rank Order of Writing Problems by Grade 
''econd Year of Study 



Fifth 




Topic 


Topic 


Wl*at to say 


What to say 


Errors 


Rewriting 


Neatness 


Errors 


Rewriting 


Neatness 


Vocabul ary 


Vocabulary 


Granunar 


Grammar 


Spelling 


Spelling 


Deglnnlng 


Beginning 


Organization 


Directions 


Directions 


Organization 


Tenth 


Eleventh 


Beginning 


Beginning 


Topic 


Topic 


What to say 


What to say 


Vocabulary 


Rewriting 


Rewriting 


Vocabulary 


Errors 


Grammar 


Grammar 


Spelling 


Spelling 


Organization 


Neatness 


Neatness 


Organization 


Directions 


Directions 


Errors 
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l^venth 


Eighth 


Ninth 


Topic 


Topic 


Beginning 


Rewriting 


Beginning 


Topic 


Beginning 


What to say 


Rewriting 


What to say 


Rewriting 


Errors 


Neatness 


Errors 


Vocabulary 


Errors 


Vocabulary 


Grammar 


Vocabulary 


Grammar 


What to say 


Grammar 


Neatness 


Neatness 


Spelling 


Organization 


Spelling 


Directions 


Spelling 


Organization 


Organization 


Directions 


Directions 



Table 1-6 

Rank Order of Writing Problems by Grade 
Third Year of Study 



Fifth 

What to say 

Errors 

Topic 

Beginning* 
Right words* 
Spelling* 
Rewriting 
Organization* 
Neatness* 
Grammar 
rections 



Sixth 
Topic 

What to say 

Right words 

Errors* 

Neatness* 

Rewriting 

Beginning 

Spelling 

Grammar 

Organization 

Directions 



Seventh 
Topic 

What to say* 

Beginning* 

Errors* 

Rewriting* 

Right words 

Grammar 

Neatness 

Organization* 

Spelling* 

Directions 



Eighth 

Topic 

Rewriting 

Errors 

Beginning 

What to say 

Right words 

Grammar 

Organization* 

Spelling* 

Neatness 

Directions 



Ninth 

Beginning* 

Topic* 

Errors 

What CO say 

Rewriting 

Right words 

Grammar 

Neatness 

Spelling 

Organization 

Directions 



Tenth 

Beginning 
Topic 

Rewriting* 

What to say* 

Right words 

Errors 

Spelling 

Grammar 

Neatness 

Organization 

Directions 



Elevent h 

3*»ginning 

Topic* 

Rewriting* 

Errors 

What to say 

Organization* 

Grammar* 

Right words 

Neatness 

Spelling 

Directions 



Twelfth 

Beginning 

What to say 

Rewriting 

Right words 

Topic 

Errors 

Grammar 

Organization* 

Spelling* 

Neatness 

Directions 



*Indicates ties 
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student Writing Achievement 



After the writing samples of those students in the throe -year study were 
hollstlcally assessed, the scores of the papers for each grade level were 
averaged, providing a score between 1 to 6, with 6 being the highest possible 
score. Table 1-7 lists the mean scores by grade level. Note that students 
selected for the study were in grades 3-10 the first year. Consequently, the 
next year most of those students were in grades 4-11, and the final year, they 
proceeded to grades 5-12. An important finding of the study is that, at every 
grade level, the mean score (or the average score) of student writing improved 
significantly from the first to the third year of the study. This indicates that 
students at each grade level at the end of the study were better writers than 
the students in that grade level at the beginning of the study. 

This improvement could be attributed to several factors. First, more 
teachers were trained by the third year of the study; thus, more students 
received writing instruction from trained teachers, causing improvement in the 
students' writing ability. Second, the school system, during the three-year 
period of the study, continued to put emphasis on writing instruction. Due to 
that emphasis, more language arts teachers put more emphasis on writing in their 
language arts instruction. As students had more opportunities to write, they 
became better writers. 

It should be noted that, at every grade level, the mean score of student 
writing dropped for the second year's writing sample. Two main factors may 
account for this decline. The writing assignment for the second year's writing 
sample may have caused problems for some stvfcdents. For the first year's writing 
assignment, students were asked to write about television. For the third year's 
assignment, students were asked to write about a person from television, a film 
or book or a person from their own lives. For the second year's assignment, 
students were asked to write about a character from a book chat they had read. 
Based on the students' writing on that topic, many student! had great difficulty 
in selecting a character from a book to write about. Some students indicated 
that they hadn't read any books or couldn't remember a character whom they found 
admirable. (Of interest to those teachers who evaluated the writing sample for 
the second year was the fact that S.E. Hinton books, especially Jhe Outsiders , 
wera the most frequently mentioned books.) 

Another reason for the lower writing scores for the second year may have 
been due to the wording of the writing prompt. For the first and third years, 
studencs were reminded, in the directions given by the teacher to "be specific." 
Unfortunately, this advice was not included in the second year's prompt, which 
may have caused some students to be less complete in their writing. 
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laoie i-/ 
Writing Achievement by Grade 



Grade Year i 





2 


.02 


(65) 


4 


2 


.15 


(54) 


5 


2 


30 


(53) 


6 


2 


63 


(54) 


7 


2 


64 


(64) 


8 


3 


09 


(45) 


9 


3 


31 


(58) 


10 


3 


58 


(53) 


11 













Year 3 




1.33 


(3) 






2.02 


(60) 






1.88 


(57) 


2.97* 


(31) 


2.33 


(64) 


2.98* 


(41) 


2.31 


(49) 


3.33* 


(39) 


2.65 


(65) 


3.44* 


(39) 


3.13 


(62) 


3.65* 


(43) 


3.40 


(60) 


4.11* 


(45) 


3.40 


(50) 


4.66* 


(29) 






4.67* 


(24) 



^Indicates p<.05 for differences from Year 1 to Year 3. 
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When we examined the effects of teacher training on student writing 
achievement, we found that whether or not the student was in the classroom of a 
trained teacher made a significant difference in the student's performance on 
the writing sample. According to the results presented in Table 1^8, students 
with a trained teacher performed significantly better on the writing sample than 
did students in the classrooms of untrained teachers. 

Cumulative exposure to trained teachers, as indicated in Table 1-9, also 
made a significant difference in student performance on the writing sample in 
the first and third years of the study. In both cases, students benefitted from 
increasing levels of exposure to trained teachers; that is, by the end of the 
study,* those students with three years of language arts instruction from trained 
teachers wrote significantly better than did those students with 2 years, 1 year 
or no years of trained instruction. Thus, in terms of writing achievement, both 
across the board, as demonstrated by Table 1-7, and in terms of the effects of 
teacher training, as demonstrated by Tables 1-8 and 1-9, the adoption of 
process-based wr5 ting instruction proved to have a positive impact on student 
writing achievement. 



Table 1-8 

Effect55 of Teacher Training on Writing Achievement by ^ear 



Xea£ 2 Year 3 



2.31 2.67* 3.25 3.61* 



*p<.05 



Table 1-9 

Effects of Cumulative Teacher Training on Writing Achievement by Year^ 



First Year Second Year Third Year 

01 012 0123 



2.69 3.04* 2.52 2.66 2.39 3.25 3.36 3.71 3.89* 

*p<.05 

^More teachers were trained each year or the study, so that the cumulative 
teacher training index indicates the number of trained teachers each student had 
over the course of the three years of the study. Thus, some students had no 
trained teachers, or a score of 0 on cumulative teacher training, while others 
had trained teachers all three years, or a score of 3 by the third year. 



Year 1 
2.69 3.04* 
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Part 2 

Results from the Langtxage Arts Teachers 



21 



T^»ph?r Attitudes about Writing 



Teachers w^re asked to respond to 14 stateoaents related to their attitudes 
about teaching writing. As Table 2-1 deiponstrates , though many of the 
differences are in the predicted direction (e.g. trained teachers are more 
likely to say that they enjoy teaching writing), teacher training in process- 
based writing instruction, in fact, accounted for signit leant differences on 
only four of the 14 statements. 

The only statement which yielded consistent differe-^ces in both the second 
and third year of the study referred to the importance of grammar in writing. 
Untrained teachers were significantly more positive in their ranking of the 
statement, "In order to be good at writing, you need to be good at grammar." 
This finding may parallel the teachers' ranking of language arts priorities (see 
Table 2-3), which demonstrates that untrained teachers consistently ranked 
"Grammar" as the top priority for language arts instruction. Consequently, 
their agreement that good writers have to be good at grammar is consistent with 
their view that grammar is very important. The more negative response from the 
trained teachers regarding the importance of grammar in writing may be a 
reflection of their acceptance of the philosophy of process-based writing. That 
is, because students write and then rewrite (catching mechanical spelling and 
grammatical errors, as well as substantive problems) with the help of peer 
editing, evea students who are weak in grammar skills can ultimately produce 
good final papers. 

In both the second and third years cf the study, trained teachers were more 
positive in their responses to the statement, "Students can learn a lot about 
writing from their peers," though the difference between trained and untrained 
teachers was significant only in the second year. Trained teachers also f«lt in 
the second year that their students enjoyed writing more than did untrained 
teachers . 

In addition, it is important to note that in the final year of the study 
v.hen a.sked about their level of confidence in their writing instruction, trained 
teachers were significantly more confident than were untrained teachers. 
Ir. response to the statement, "I am more confident about my writing instruction 
t'aan I was two or three years ago" significant differences -merge between 
trained and untrained teachers. These higher scores by trained teachers would 
indicate that the training in the process -based writing instruction made them 
more self-assured about their own writing instruction. In contrast, untrained 
teachers were less confident about the quality and effectiveness of their 
writing instruction. 
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Tabic 2-1 

Teacher Attitudes about Writing by Teacher Training 





Second 
U 


Year 
T 


Third 
U 


Year 
T 


1 enjoy i:eacning writing. 


3 


.38 


3 


.46 


3.19 


3 


.30 


My students enjoy writing. 


2 


.70 


3 


.08* 


2.86 


2 


.72 


Knowing about writing will help 
my students get better jobs. 


3 


.55 


3 


.56 


3.68 


3 


55 


In order to be good at writing, 
you need to be good at grammar. 


3 


.15 


2 


72* 


3.14 


2 


72* 


±11 oruer to oe goou ac \ riting, 
you need to be good at spelling. 


Z 




Z 


io 


2.73 


2 


52 


Students can learn a lot about 
writing from cheir peers. 


3 


.15 


3 


48* 


3.27 


3. 


45 


In order to teach students how 
to write, one has to develop 
one's own skills as a writer. 


3 


.33 


3. 


30 


3.23 


3. 


54 


My studenr:s learn a lot from 
re-rewriting their papers. 


3 


.11 


3. 


20 


3.14 


2. 


93 


I try to mark all errors on my 
students ' papers . 


2 


.00 


1. 


85 


2.27 


2. 


18 



Students can give each other 3.44 3.40 3.36 3.36e 

good ideas and suggestions 
about writing. 



The texts we use provide good 2.28 1.85 2.05 

instructions on how to help 
students re-write their papers. 



I am more confident about my 2.68 
writing instruction than I was two 
or three years ago. 

*p<.05 
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1.82 



I stress the writing process 3.30 3.52 3.36 3.10 

in my teaching. 

I teach writing totally differently 2.50 2.43 2.32 2.68 

than I did two or three years ago. 



Te^Qb^y Attitudes about Wr iting Problems 



Teachers were presented with a list of problems specific to teaching 
writing and were asked to rate each problem in terms of its Importance in their 
own writing instruction. The problems were stated as follows: 

Inadequate time to plan appropriate writing activities. 

Lack of training in how to teach writing. 

Lack of consistency within system on how to teach writing. 

Lack of adequate class time to complete writing activities. 

Too large a class to teach writing. 

Lack of suitable materials to teach writing. 

Lack of time to evaluate student writing. 

Lack of agreement among teachers on standards for student writing. 

The results, presented in Table 2-2 below, demonstrate that each year of 
the study, teachers had the same number one problem related to teaching 
writing- -"Lack of time to evaluate student writing." This problem was mentioned 
frequently in meetings of the language arts teachers and the Writing Committee, 
as well. Thus, there appears to be consensus on the lack of time for evaluation 
as a critical problem for teaching writing. 

Teachers pointed out that every time they give a writing assignment, they 
then have a set of papers to evaluate. That could mean a set of 25 papers for 
an elementary school teacher who teaches one language arts class a day. But if 
that same teacher had the students write for a science or social studies 
activity, then the number of papers would quickly multiply. 

For junior and senior high English teachers, who typically teach five 
classes a day, one writing assignment for a class each w^ek would result in 100 
to 150 papers to read. If the assignment were a multi-paragraph essay or a 
multi-page paper, the sheer volume of material to be read and evaluated is 
overwhelming. 

The teachers agreed that having one planning period a day simply does not 
provide adequate time to evaluate all the student writing in addition to all the 
other duties that teachers have during planning time such as planning lessons, 
making phone calls to parents, completing attendance reports and other school' 
forms, and meeting with other teachers. 

The second concern of teachers during the second and third year of the 
study was "Inadequate time to plan appropriate writing activities." In the 
workshops and training programs when teachers were instructed in process -based 
writing, teachers agreed that they could see how writing assignments could 
become a more integral part of their curriculum. However, they explained that 
developing writing assignments that were an integrated part of a unit- -rather 
than just an isolated writing assignment- -would require additional planning 
time. Teachers said that they would need additional time to modify and adjust 
their existing units of instruction and time to develop new units that would 
include process-based writing assignments . 

"Lack of adequate class time to complete writing activities" was a problem 
ranked second or third all three years. Teachers said that a key problem for 



18 

24 



increasing the amovint of student writing was the lack of adequate time. This 
problem is two -fold. 



First, teachers, especially those teachers involved in preparing students 
for the state proficiency r:est or meeting Basic Skills First requirements, said 
that their curriculum was so structured that they did not have the time or 
flexibility to work in regular writing assignments. These teachers spend so 
much time on reviewing grammar and testing and retesting students for individual 
skills that they do not have time to include an emphasis on writing activities. 

Second, te&chers said that class periods often were not long enough to have 
a well developed writing activity following the sequential steps advocated in 
process«based writing. O'.ten, there is inadequate time for a pre-writing 
activity to lead into an in-class writing assignment. When students work in 
pairs or in small groups reading and editing their classmates' papers, a class 
period is inadequate for the whole writing process to be followed. 

The size of language arts classes also was a serious problem, according to 
the language arts teachers. They noted that the larger the class, the more 
papers that had to be evaluated for each assignment. At the junior and senior 
high levels, the difference between 22 and 27 students in English classes, makes 
a difference of 25 students for the day- -and 25 papers for each assignment- -the 
equivalent of another class section. 

"Lack of suitable materials to teach writing" was the least concern every 
year. Teachers said that the materials they had were suitable or could be 
adapted to be used for writing activities. 

Also, it should be noted that by the second year, "Lack of training in how 
to teach writing" was not considered a problem, whereas the first year of the 
study, this was the third greatest problem. 



Table 2-2 

Rank Order of Problems with Teaching Writing 



Time for Evaluation 
Time to Complete 
Lack of Training 
Planning Time 
Inconsistency* 
Large Classes* 
Standards 
Materials 



Second Year 

Time for Evaluation 

Planning Time 

Time to complete 

Large Classes 

Inconsistency 

Standards 

Lack of Training 

Materials 



Third Year 

Time for Evaluation 
Planning Time* 
Time to complete* 
Large Classes 
Standards 
Inconsistency 
Lack of Training 
Materials 



In terms of their ratings of the importance of these problems, no significant 
differences appeared betv/een trained and untrained teachers after the first year 
of the study. 
*Indicates ties 
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Ag??ggmm fl£ Ungvagg Art? instruction Priorities 

In the second and third years of the study, teachers were asked to rank 
14 different language arts priorities. Choices were stated as follows: Grammar, 
Literary Appreciation, Essay Writing, Composition, Drama, Creative Writing, 
Research Writing, Reading Poems, Reading Shoct Stories, Reading Novels, Using a 
Computer, Using a Word Processor, Watching Television. Responses were then 
analyzed based on teacher training as presented in Table 2-3. Two major 
findings should be noted. The second year of the study, the top priorities were 
quite similar regardless of the teachers' training in process-based writing 
instruction. The untrain-td teachers ranked "Grammar" and "Composition" as the 
first priorities. The trained teachers ranked "Composition" as the first 
priority, and "Grammar" as the third priority. In the third year of the 
study, the untrained teachers continued to rank "Grammar" as the first priority 
and "Composition" fell to the sixth priority. However, the trained teachers 
again ranked "Composition" as the first priority, but "Grammar" fell to the 
fifth place. These findings suggest that during the course of the study, 
trained teachers became more firmly committed to teaching composition in an 
integrated manner, treating grammar and mechanics as only one part of the entire 
writing process, whereas untrained teachers continued to consider grammar an 
independent component of the language arts curriculum. 



Table 2-3 

Teacher Assessments of Language Arts Priorities by Teacher Training 



Second Year 



Untrained 



Trained 



Untrained 



Trained 



Grammar* 
Composition* 
Short Stories 
Novels 

Essay Writing 
Lit. App. 
Creative Writing 
Research Writing 
Poetry 

Public Speaking 

Drama 

Computer 

Word Processor 

TV 



Lit. App. 
Essay Writing 
Creative Writing 
Poetry* 
Novels* 

Public Speaking 
Drama 

Research Writing 
Word Processor 
Computer 



Composition 
Short Stories 
Grammar 



Grammar 
Lit. App. 
Creative Writing* 
Research Writing* 
Short Stories 
Composition 
Essay Writing 
Novels 
Poetry 

Public Speaking 

Drama 

Computer 

Word Processor 

TV 



Composition 
Short Stories 
Li t . App . 
Essay Writing 
Grammar 
Novels 

Creative Writing 
Poetry 

Research Writing 

Public Speaking 

Word Processor 

Computer 

Drama 

TV 



*Indicates ties. 
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CpffiPftrlSPn qI £ar£n£ find T^ftgher Attitudes about Unguage Arts Prior ities 



When teacher responses to these 14 language arts prlritles are compared to 
parents' responses to the same Items, some Interesting differences emerge (See 
Table 2-4). Teachers and parents differed In their ranking of the top priority 
for language arts Instruction. In the second and third years of the study, 
teachers as a group ranked "Composition" as the top priority. AH three years 
the parents were surveyed, they ranked "Grammar" as the top priority, with 
"Composition" as the second priority. The teachers ranked "Grammar" as the 
fourth priority the second year of the study and the third priority the third 
year of the study. In both years, the teachers ranked "Literary Appreciation" 
ahead of "Grammar, whereas parents never ranked "Literary Appreciation" more 
than the seventh priority. 

Research has consistently shown that grammar Instruction which consists of 
drill and practice grammar exercises does not necessarily transfer into Improved 
grammar in the students' writing or speaking. This is one of the reasons cited 
for using process-based writing instruction, where mechanical skills such as 
grammar and spelling are treated as one part of the whole. Integrated writing 
process. Teachers trained in process -based writing, as demonstrated In Table 2- 
3, adopted this line of reasoning, and because most teachers were trained by the 
third year of the study, this view dominates teacher responses and accounts for 
the lower ranking of "Grammar" among teachers. However, parents were educated 
following a different approach to language arts instruction, one of repeated 
grammar drill and practice. 

Another difference between teachers' and parents' rankings aprpeared in 
their views of computer instruction. "Computer" and "Word Processing" were two 
of the 14 topics that the two groups were asked to rank. The first year of the 
study, parents ranked "Computer" as the third priority and "Word Processing" as 
the eleventh priority. By the third year, "Computer" was the ninth priority 
with "Word Processing" remaining the eleventh priority. In 1984, when the 
parents first completed the questionnaire, computers were just entering the 
scene at home and the schools. Parents may have considered computers to be a 
potential cure-all for language arts instruction and an Important aspect of 
contemporary literacy. Two years later, after having more experience with 
computers and being aware of computer use in the schools, parents may have 
realized that the instrv ,tional value of computers in language arts instruction 
was more limited than they first imagined, thus, making language arts 
instruction in "Computer" a lower priority. 

Teacher assessment of "Computer" and "Word Processing" as priorities in 
language arts instruction did not change much during the study. When first 
surveyed about language arts priorities, teachers ranked "Computer" as the 
eleventh priority and "Word Processing" as the thirteenth priority. The next 
year, the order of the two topics was reversed. Teachers' low ranking of 
computers and word processing may stem from two main reasons. First, most 
language arts teachers had not received training in the use of computers and 
were hesitant or unable to use them in their classrooms. Second, the teachers 
knew the actual number of computers and necessary word processing software 
available in the schools were limited. These limitations were likely to cause 
the teachers to be cautious in assessing the Importance of the computer in 
language arts Instruction. 
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Both the teachers and the parents ranked "Television" as the last priority 
for language arts instruction. Drama also received a low ranking by teachers and 
parents. For two years, teachers ranked "Drama" as the twelfth priority in terms 
of importance. The parents ranked "Drama" as the thirteenth priority all three 
years . 



Table 2-4 

Parent and Teacher Assessments of Language Arts Instruction Priorities 



Xeai 1 

Grammar 

Composition 

Computer 

Research 

Creative 

Essay 

Lit. App. 

Speech 

Novel 

Short Stories 

Word Procejsor 

Poetry 

Drama 

TV 



Parents 

Xe^ Z 
Grammar 
Composition 
Research 
Essay 
Creative 
Novel 

Short Stories 
Computer 
Lit. App. 
Speech 

Word Processor 

Poetry 

Drama 

TV 



Grammar 
Composition 
Essay 
Research 
Creative 
Novel 
Lit. App. 
Short Stories 
Computer 
Speech 

Word Processor 
Poetry 
Drama 
TV 



Composition 

Short Stories 

Lit. App. 

Grammar 

Creative 

Essay 

Novels 

Poetry 

Speech 

Research 

Computer 

Drama 

Word Processor 
TV 



Teachers 
Year 3 

Composition 

Lit. App. 

Grammar 

Short Stories 

Essay 

Creative 

Novels 

Research 

Poetry 

Speech 

Word Processor 

Drama 

Computer 

TV 
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Part 3 

Limitations of the Study 
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In any research study, it is important to note what limitations mfiy qual 
its results. The three-year study of writing in the Oak Ridge Schools had 
several important limitations: 

1. Inconsistency Id writing training for te achers. During the 
three years of the writing study, language arts teachers were 
encouraged to participate in training in process -based writing. 
This training was offered in a variety of ways: as a credit 
course taught by an instructor from the University of Tennessee, 
as an in-service session taught during the school year by trained 
Oak Ridge teachers, as a one-week workshop taught during the summer 
by trained Oak Ridge teachers. All training sessions were 
designed to introduce teachers to process-based writing and 

all sessions required that teachers participate in the writing 
process themselves. However, all sessions were not taught by 
the same instructors, did not have the same assignments, and 
did not follow the same curriculum. Consequently, the training 
was not uniform. 

2. Jh&. difficulty In developing comparable writing prompts . Each year, 
the Writing Committee- -made up of language arts teachers 
representing primary, elementary, junior high and senior high 
levels --determined the topic for the systemwide writing sample 

and then wrote the exact wording to be used as the prompt for 
the assignment. The scores on the writing sample assessments 
the second year were lower than the first or second year. 
This may be due to the fact that the topic selected by the 
committee the second year was more limiting to the student 
than the topics selected for the first and third years. 

3. Ihfi difficulty in retaining students irj the sample during the 
illlSfe ^ study. Initially, about 90 students were 
selected from each grade level, grades 3-10. This number was 
selected in order to retain at least 50 students at each grade 
le\el for all three years of the study. We anticipated losing 
ixbcut 10 to 15% of the student sample each year as a result of 
normal attrition. However, even the first year of the study 
the sample size was considerably lower than 90 students per 
grade level because of various problems in locating individual 
students. For example, students whose names had changed as a 
result of a parent remarrying were difficult to identify, and 
students who preferred to use a nickname or a first name only, 
made it nearly impossible to locate their papers. Such problems 
reduced the initial sample size significantly. Normal 
attrition, with students moving away or dropping out of school, 
then took its toll on the remaining students. In addition, in 

the third year of the study, there was inconsistent teacher follow-up 
on absences so that some students who were not in class during the 
week of the writing sample never completed it. As a result, by 
the end of the third year, writing samples for nearly half of the 
students were missing. 
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Part 4 
Recommendations 
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Recommendations of the Writing Committee 



The committee recommends that three groups be appointed at each 
of the levels (elementary, junior high and senior high schools) 
to analyze the effects of scheduling and class load for programs 
which promote writing and composition. This recommendation is 
supported by the "Time for Results" priority number one. 

The committee recommends continuing the financial and time 
support for teacher training in writing. Regularly scheduled 
inservice should be offered as refresher sessions for trained 
teachers; financing should be made available to teachers to 
attend conferences: to learn new research and techniques related 
to the teaching of writing; summer sessions should be budgeted 
and scheduled for new staff members in the Oak Ridge Schools. 

The committee recommends increased financial support for 
student writing products such as classroom writing projects, 
class newspapers and literary magazines. Additional clerical 
assistance is needed for typing and copying "published" student 
work. 

The committee recommends continuous education of parents and 
the public about the process approach to teaching writing. In 
order to develop more parent awareness and support of the schools' 
efforts to improve writing instruction, comprehensive comriunication 
should be promoted between the schools, the parents and the 
community. 



ERIC 



24 

9^ 32 



Appendices 



ERJC 



33 



Appendix A 
Student Writing Assignments 



1984 WyUj-ng Assignment 

Grades 3-5: Each of you has many television programs th 
you watch ^nd enjoy. I want you to choose a favorite 
character from one of those programs. I want you to 
describe this character and explain why you like the 
character so much. 

Grades 6-8: Television plays a big part in our lives 
today. There are many reasons that we watch tele-vision. 
Think ot one or two of these reasons and write about 
them in one or two well developed paragraphs. 

Grades 9-12: In a multi -paragraph paper, discuss the 
Influence of television on you and your family or on 
-American society. Be specific. 

1985 Writing Assignment 

Grades 3-8: Each of you can think of many books that 
you read and enjoy. Choose a favorite character from 
one of those books. Describe this character and explain 
why you like the character so much. 

Grades 9-12: Each of you can think of many books that 
you read and enjoy. Choose a favorite character from 
one of those books. In a multi -paragraph paper, discuss 
why this character appeals to you. 

1986 Writing Assignment 

Grades 3-5: Choose a real person or a character from a 
book, movie, or TV show who you like. Explain why you 
like him or her. Give more than one reason. 

Grades 6-8: Select a real person or a character from a 
book, movie or TV show who has had a;i influence on you. 
Explain this influence. Be specific. 

Grades 9-12: Select a real person or a character from a 
book, movie, or TV show who has had an influence on you. 
Explain this influence in a multi-paragraph essay. Be 
specific. 
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Appendix B 
Assessment Rubric 

6 A £ paper has most of the following characteristics: 

Focus: appropriate central idea (thesis) and takes a position on the topic 
which remains consistent 

Organization: displays visible, consistent levels of abstraction 

(parallelism in logic) and correct paragraph structure 

Development: provides adequate and appropriately expanded examples/proof 
to support thesis 

♦♦establishes a clear relationship between examples and thesis 
Sentence Structure: displays correctness and variety 
Mechanics: displays correctness in spelling and punctuation 
Vocabulary: is appropriate and varied— "sparkles" and/or "fluent" 

5 A 1 paper has most of the following characteristics: 

Focus: appropriate central idea (thesis) and takes a position on rhe topic 
which remains consistent 

Organization: displays visible, consistent levels of abstraction and correci 
paragraph form 

Development: provides some examples and details but not as concrete as a 6 
Sentence Structure: correct but not polished sentence structure 
Mechanics: displays correctness in spelling and punctuation 
Vocabulary: appropriate but not succinct 

4 A 4 paper has most of the following characteristics: 
Focus: central idea may be stated or implied 

Organization: pattern has some degree of success although it may have 
weaknesses in levels of abstraction 

Development: contains appropriate examples but inadequately developed 
(expanded) 

Sentence Structure: displays correctness but lacks variety 

Mechanics: although errors in punctuation and spelling exist, they do not 
interfere with the meaning 



Vocabulary: co jnonplace 

A 1 paper has most of the following characteristics: 

Focus: central idea may be stated or implied but deteriorates 

Organization: repetitious, "stream-of -consciousness" pattern and flawed 
in paragraph form; may mix levels of abstraction 
inappropriately (apple, orange, pork chop) 

Development: examples are inadequate and undeveloped (mere listing) no 
relevance between central idea and examples is established 

Sentence Structure: may have some fragments and run-ons, but they do not 

interfere with meaning 

Mechanics: although errors in punctuation and spelling exist, they do not 
interfere with meaning 

A 2, paper has most of the following characteristics: 
Focus: is absent or fails to address the complete topic 
Organization: omission of levels of abstraction 

Sentence Structure: contains many fragments and run-ons and has poor 

syntax and grammar; monotonous sentence pattern 

Development: examples are inadequate, inappropriate, and undeveloped 

A 1 paper has most of the following characteristics: 
Focus: irrelevant to topic 

Organization: random thoughts and an absence of a pattern of logic 

Development: simplistic, undeveloped, random examples/details and/or 
implied reasons 
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Appendix C 
Types of Computers in the home 



Because the Oak Ridge Schools have included instruction in computer use as 
part of ths curriculum &t the elementary school, junior high school, and senior 
high school levels, an item was included on the parental questionnaire to 
determine how many homes had computers. 

In 1984, during the first year of the study, 49% of the responding parents 
said that they had at least one computer in the home. By 1986, 63% of the 
responding parents said that they had a computer in the home. Parents, in the 
1984 study, were asked to indicate the brand name of the computer they'had. 
Parents listed 26 different types of computers. (See Table 3-1) The Apple was 
the most frequently named computer, although only 8.5% of the homes had that 
brand of computer. 



Table 3-1 
Types of Computers in the Home 1984 



Apple 1^ 

Commodore 

Texas Instrument 

Vic 20 

TRS 

IBM 

Franklin Ace 

Compad 

Odyssey 

Timex 1000 

Sorcerer 

Kaypro 

Adam 

Columbia 

Sinclair 

Altcs 

Corona 

Digital 

Morrow 

Mcintosh 

RCA 

Epson 

Magnavox 

Osborn 



^Listed in the order of most frequently mentioned to least frequently mentioned. 
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Appendix D 
Oak Ridge Schools 
Writing Committee 

1987-88 



Julie Dodd ORHS 

Ann Johnson ORHS 

Carol Yoakley ORHS 

Lois Nolan oRHS 

Martha Deaderick jjhs 

Naida Finane ORHS 

Jane Grossbeck RJHS 

Donna Sutton RJHP 

Betty Felte gW 

Candace Boyd q\j 

Bobbie Nielson GW 

Carolyn Stevens WL 

Ginny Bowers wb 

Theresa Pickerell L 

Elizabeth Breaseale L 

Joan Vicary SAB 

Jinx Bohstedt SAB 
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